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and the Effect of Teacher Acquaintance 
with Instructional Materials 

Robert W. Pranis 
Industrial Relations Center, The University of Chicago'"' 



Little evaluation research has been done to date in the field of economic edu- 
cation. Although this can also be said to be somewhat true in the field of education 
generally, it seems of particular import for economic education because of a grow- 
ing awareness of the need to include economics as a subject in the elementary 
school curriculum. 

The Industrial Relations Center of The University of Chicago (IRC) has been 
developing economics programs for elementary schools for a number of years. 1 In 
addition to the writing of instructional materials for the program, considerable ef- 
fort is devoted to the development of pre- and post-tests of economic understanding. 

It is common in educational research to take advantage of data gathered during 
test development to throw light on some questions which, ordinarily, would not be 
investigated until the test development was complete. During the third year of field 
testing its sixth grade program in economics, 2 the Industrial Relations Center took 
advantage of such an opportunity. 



The author is indebted to William D. Rader, James R. Murray, and 
Howard A. Sulkin of the Industrial Relations Center for their suggestions on this 
paper. 

This research and development effort has been funded by the Charles 
Stewart Mott Foundation of Flint, Michigan. 
2 

The Industrial Relations Center, The University of Chicago, Economic 
Man (Westchester, Illinois: Benefic Press, 1970). The research editions of 
this program were called Elementary Economics III: Exchange. 



Research Focus 



. A recurring research concei-n of the IRC has been to demonstrate significant 
increase in economic understanding in students from various socioeconomic status 
(SES) communities- Using the pre -post tests, it was decided to demonstrate that 
learning took place at each SES level. There were two factors to be considered in 
determining whether an incre ase in economic understanding took place. One, some 
evidence existed that, at a given grade level, the rate of change was greater in 
some SES levels than in other levels. Two, students who initially helped pilot test 
this program tended to be from upper and middle class suburbs. It was decidefl 
not to compare the amount of the learning among the various SES students since a 
v/ealth of existing evidence indicated that, in general, the higher the SES level the 
higher would be the indices of learning. ^ 

Another research concern of the IRC has to do with the effect on student 
learning of teacher familiarity with the' materials. Among the many barriers to 
innovation in the school curriculum is the seemingly natural reluctance of teachers 
to teach a subject about wliich they feel they know little. Not the least threatening ■ 
of these subjects is economics. 

An increasing number of articles and reports point to the desirability and 
need for economic education in schools."^ Although a number of teachers with 
course and workshop training are teaching economics at the high school level, few 
elementary teachers have training in economics. In fact, the typical elementary 
school teacher^s exposure to economics as a discipline is a semester or two in col- 
lege—and that several years ago. 

The effect of this lack of training in economics by elementary teachers was 
observed recently in planning a field test of the sixth grade program. A number of 
sixth grade teachers we're asked if they would be willing to teach the program to 
their students. Quite often the initial reaction was one of reluctance. The teachers 
pointed out that they would not be good teachers for this program since they knew 
little about economics, and they were unfamiliar with the materials. 

A much higher degree of acceptance was received when the teachers were 
offered one day of in-service training before starting to teach the program. In- 
service training consisted of one or more members of the program development 
staff meeting with the teachers and going over all of the materials, explaining the 
rationale of the various lessons, leading the teachers through a simulation game. 



For example, N. L. Gage, ed. , Handbook of Research on Teaching (Chicago: 
Rand McNally and Company, 1963), p. 739. 
4 

One of the most important of these is Report of National Task Force on Eco- 
nomic Education, Economic Education in the Schools (New York: Committee for 
Economic Development, September, 1961). 
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clarifying certain economic concepts and answering any questions the teachers may 
have had. At the end of the school year, most of the teachers who taught the pro- 
gram reported that the program had been successful and that they were very pleased 
to have participated. 

It was realized, however, that economically and logistically, mass in-service 
training would be impossible once the program was out of the field-test stage and on 
the market. For purposes of this study, then, it was decided to investigate the ef- 
fect of teacher acquaintance with the materials on student learning of the economics 
program . 

The Design and Sample 

Teachers who had acquired a yearns experience with the materials from the 
previous yearns field test were asked to teach the program another year. Two new 
groups of teachers were also chosen. One group would receive the materials and 
one day of in-service training; the other group would receive the materials but no 
training. Both new groups would then be asked to teach the program to their students. 

Experienced Teachers 

Twenty teachers who had taught the program in the previous year were avail- 
able to participate in the study. In each system where the program was field tested, 
a contact person (superintendent, assistant superintendent, curriculum director, 
social studies director or principal) obtained the cooperation of their teachers. The 
teachers contacted were usually those who the contact person thought would be inter- 
ested in and willing to innovate a ne'^v program. 

The contact person was asked to select teachers from schools in high, middle 
and low socioeconomic neighborhoods. Each contact person was asked to use his 
own judgment in making the SES designations. Some contact people expressed dis- 
comfort at making these judgments. No attempt was made to get a second opinion 
of the designations. 

From the previous year's list of experienced teachers, five teachers were 
randomly selected from each of the three socioeconomic levels. Letters were sent 
to these fifteen teachers asking if they would again be willing to teach the program. 
Only one teacher declined to participate as she was involved in another social studies 
project under a Title I grant. Another teacher fell ill in the middle of the program 
and her class was dropped from the study. 

In-Service Trained and Non- 
In-Service Trained Teachers 

Six additional school systems agreed to allow their teachers to participate in 
this field test. This time, instead of asking the contact person to select the teach- 
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ers, each contact person was asked to submit a list of all available sixth grade 
teachers and an indication of the socioeconomic level of each school. Again, the 
SES designation was up to the contact person. 

Using a table of random numbers, teachers were randomly chosen from each 
contact^s list to fill our need of program teachers. Because of the expense of in- 
service training, it was decided to have all of the selected teachers in three school 
systems receive the training rather than to try to train a select few in all six sys- 
tems. All of the teachers in any given school system received in-service training 
at the ;F.ame time. 

The random and non- random aspects of this selection process should be kept 
clear. The systems^ involved in the field test were selected on the basis of availa- 
bility, although an attempt was made to draw them from differing geographic areas 
of the nation. Participating schools were located in California, Connecticut, Illi- 
nois, Michigan, Minnesota, and Texas. For the in-service and non-in-service 
sample, a list of available teachers was obtained from each system. The contact 
person in each system indicated for each school whether, in his opinion, it was in 
a high, middle, or low socioeconomic neighborhood. Teachers were then randomly 
chosen from these lists and were asked if they would be willing to teach the program 
to their class. If the teacher declined the request, another teacher from that system 
was randomly selected. Of the six systems, three were randomly chosen to have 
their teachers receive the in-service training. 

When new classroom materials are being evaluated, a possible source of 
bias is the attitude of the teacher who volunteers to try them out with her class. 
The eager volunteer teacher may transmit this eagerness to her students. Under 
these conditions, any kind of program could be successful. In this study, random 
selection of the new program teachers was used to minimize the effect of the over- 
ly eager teacher. 

Because the teachers who taught the program in the previous year were not 
selected by the process just described, the experienced teacher group is more 
likely to contain the eager volunteers. 

Control Teachers 

After the program teachers were selected from the list of available teachers, 
the control teachers were randomly selected from those remaining on the list. The 
selection process was similar to that described above with one exception. When a 
teacher declined to teach the program she was kept on the list as an available control 
teacher. One of the control teachers asked that both of her social studies classes go 
through the same experience, i.e., receive the pre- and post-tests. Thus, we had 
one more control class than the design called for. The number of classes and their 
designation is shown in Table 1. 



ERIC 



tahlh: 1 

The Number and Types of Classes in tlie Study 









Classes of 


Total 




Socio- 


Classes of 


Classes of 


Non-In-Service 


Classes 




Economic 


Experienced 


In-Service 


T rained 


Receiv'in£T 


Cnntr*ol 


Level 


Teachers 


Trained Teachers 


Teache rs 


Program 


Classes 


High 


5 


6 


6 


17 


() 


Middle 


6 


5 


6 


17 


5 


Low 


3 


5 


5 


13 


5 


Total 


14 


16 


17 


47 


16 



The Program 

The Economic Man program was developed by the IRC over a period of five 
years. The program focuses on the economic concept of exchange and requii'es 
40 minutes teaching time a day, five days a week for 21 weeks. The program con- 
tains three units of 8, 5, and 8 weeks. 

Unit I concerns a young man who is shipwrecked on a deserted tropical island. 
There he has to make economic decisions about how to spend his time and how to 
take advantage of the island's resources. Later, others are shipwrecked on the 
island and specialization and division of labor develop. There are many opportuni- 
ties for students to engage in role playing, team activities, and arts and crafts. 
Some teachers report that students who are ordinarily^'duU'* in social studies often 
become actively interested in Unit I, 

Unit II is built around a simulation game called MARKET. The class is divid- 
ed into retailer and consumer teams. Each retailer-team sells to the consumers 
and tries to make the largest profit. Consumer teams circulate among the retailers, 
search for the most competitive prices and attempt to satisfy dinner meal require- 
ments with a limited amount of money. There is much moving about and interaction 
of the students during the game. This unit involves price theory and the determina- 
tion of a market clearing price from supply and demand lines. Unit III concerns 
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problems in international trade and introduces graph reading. On the whole, the 
program was developed to contain something to interest a wide variety of students. 

The Testing Instruments 

Economic s Tests 

Tests of general economic understanding wf?re not available at the sixth grade 
level. The closest available test of general economic knowledge was designed for 
the 12th grade. ^ Tests had been developed by the IRC to be used with its programs 
for the 4th and 5th grades, but these tests were judged to be too definitional and too 
program-specific for purposes of this study. 

The tests used in this study were the third versions of the instruments devel- 
oped to measure the economic understanding learned in the sixth grade program. 
The items in these tests were designed to ta.p each of the important knowledge con- 
cepts, generalizations and main ideas in the program. Although a vocabulary knowl- 
edge component exists in some of the items, an effort was made to construct items 
which contained a higher level of cognition rather than items of a definitional nature 
only. Based upon Bloom's Taxonomy , 6 it is believed that a large number of the items 
are at least at level four— analysis. 

The tests consist of multiple-choice items and are untimed. For the pre-test, 
62 items were developed which covered most of what the authors of the program 
judged important. For the post-test, a smaller number of different items were de- 
veloped (56 items) which also covered the important parts of the program. Little 
attempt was made to match all items as to either content or form; this was done, 
however, when possible. 

rntelligence Tests 

A variable that should be considered in this type of research is intelligence, 
i.e., whether differences in classroom scores on the pre-post tests may have been 
due to a significant difference in the intelligence level of the children in each class. 
Although it would not be surprising if classes of students from different SES levels 
were to score differently on the pre-post tests, it can be expected that classes of stu- 
dents from the same SES level, chosen randomly, would score similarly on these tests. 

The Otis-Lennon Test of Mental Ability (Form K) was selected to be adminis- 
tered to all children in the study to ensure that the different treatment groups at the 



Committee for Measurement of Economic Understanding, Test of Economic 
Understanding (Chicago: Science Research Associates, 1963). 
6 

B. Bloom, ed. , Taxonomy of Educational Objectives: Cognitive Domain 
(New York: David McKay Company, Inc. 1956). 



same SE3 level did not differ in intelligence. This test consists of 30 items and is 
timed for 40 minutes. 

The intelligence tests and the pre-tests were administered by the teachers in 
January 1969. The post-tests were administered at the end of the school year. For 
most schools this w^as in the first or second week of June 1969. 

Results 

Only students who had both pre- and post-tests of economic understanding are 
included in this study. All but 12 of these students took the intelligence tests. Un- 
less otherwise noted, the results for the economic tests are reported in terms of 
percent of number of items. The intelligence test results are reported as raw 
scores. 

Reliability of Economics Tests 

Table 2 shows the raw score means and standard deviations (S.D. ) for all 
program and control students for both the pre- and post- tests with KR-20 reliabil- 
ity estimates. 



TABLE 2 

Means, Standard Deviations, and Reliabilities of Pre- and Post-Tests 



Program Students 


Pre-Test 


Post-Test 


1229 






Tviean 


36.41 


45. 61 


S.D. 


1 6 1 


13. 89 


^tt (K-R 20) 


. 71 


.81 


• Control Students 






N = 440 






aMean 


;^4. 73 


35. 32 


S.D. 


0. 68 


10.52 


^tt (K-R 20) 


. 65 


. 67 



It was expected that the highest reliability estimate in the post-test would be 
for students who had taken the program. In the other three testing situations, the 
students would be more likely to guess at the right answers which would increase 
the error variance of the test and reduce the reliability. Such a difference in pre- 
test reliability between the program and control students was not expected. Since 
differences were found, however, one could speculate that the program teachers let 
it be known that the pre-test was part of a new program which the students were 
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about to start. The control teachers could have found it difficult to justify the trea- 
son for taking the test to their classes. 

The Intelligence Test Results 

Table 3 shows the average raw scores and standard deviations on the Otis- 
Lennon Intelligence Test for each of the groups used in this study. 



T AM I.I': 3 
Intelli thence 'I'est Sc^^^es 



si-:s 
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Trained 


Non-T rained 


( Ont rols 








N--170 


N 162 


\ 1 50 


o 




62. 05 


60. 78 


63. 12 


62. 1^5 




S.J). 


11. 71 


13.07 


11. 38 


7. 1)5 








N=128 


N-=15f) 


N-154 


DDI 


Moan 


58. 82 


61 . 02 


59. 73 


61 . 77 




S. D. 


13.35 


12. 33 


13.47 


10. 69 






N-76 


N^lll 


N=130 


N-131 


q 


Mean 


50. 34 


43. 13 


45. 04 


46. 15 




S.D. 


15. 24 


16. 31 


15. 28 


15.23 



While no significant differences were expected within any SES level, three 
such differences occurred. In the higher SES level there are no significant differ- 
ences between the groups. In the middle SES level the students with experienced 
teachers were 2.95 raw score points lower than control students. This results in 
a T of 2.14 which is significant beyond the .05 level of confidence. In the low SES 
level, students with experienced teachers were significantly higher than the other 
two program groups. Students with experienced teachers were 7.22 points higher 
than those with in-service trained teachers (T = 3.07; p ^ . 01). They wer^e 5.30 
points higher than those with no in-service training (T = 2.40; p ^. 05). 

Program Compared to Control Students 

The first aim of this study was to show that students at all socioeconomic lev- 
els taking the program evidenced greater learning in economics than comparable 
control students. Some gain from pre- to post-tests with the control students is ex- 
pected, however, because of factors such as an increase in reading ability. Since 

7 " 

The IQ equivalence for Otis-Lennon test results is based on age to the near- 
est three months. This age data was not obtained in this study. 
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the control teachers had no previous acquaintance with the program, the most mean 
ingful groups of students for comparison would be program students whose teachers 
also had no previous acquaintance with the program. 

Table 4 shows the pre- and post-tests results for these groups. The figures 
are given in percent of total number of items — 62 items for the pre-test and 5G items 
for tne post -test. 



TABLE 4 

Means, Standard Deviations and C"orrelations Between Pre- and Pf?st~Test 
Taken by Pi-ogram and Control Students of Different SKS Levels 
Whose Teachers Had No Previous Acquaintance with the 
Program Materials 



SES 




Program Students 


Control Students 








Pre 




Post 


Pre 


Post 










N=164 








N=152 






Mean 




38. 62 




49. 


31 


36. 


65 


37. 49 




S.D. 

r , 
(pre- 


post) 


9.40 


. 65 


12. 


26 


9. 


43 

.47 


11. 00 










N = 159 








N=156 
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Mean 




39, 15 




48. 


23 


36. 


66 


36. 10 


C 
1— ( 


S.D. 




9.83 




12. 


94 


9. 


94 


10. 94 




r . 
(pre- 


post) 




.61 








. 69 












N = 134 








N=132 






Mean 




29. 95 




34. 


83 


30. 


22 


31 . 03 


O 


S.D. 




8. 91 




9. 


87 


7 


93 


8. 35 




r . 
(pre 


-post) 




. 49 








.46 





The pre-post gains in Table 4 are easier to identify if graphed as in Fig. 1. 
The most striking data in Fig. 1 is the large gain from pre- to post-tests of the pro- 
gram groups compared with the control groups. At each of the SES levels the pro- 
gram students made significant increases from pre- to post-tests over their corres- 
ponding controls. 

Table 5 identifies the T tests of significance of gain for each group. Table 6 
shows the T tests of significance for the differences of gain between program and 
control students. 
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Fig. 1. Pre- and post-test averages 
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TABLE o 
T Tests of Gain Scores for J'^rnpT-am 
and C'ontrol Studoiv 



SMS 




Program 


wi. rol 






N- 164 


N=l 52 










c 


Gain 


10. 60 


. 84 




SE of Gain 


. 74 


. 86 




T 


14. 56-- 


n. s. 






N=159 


N=156 


Q 


Gain 


9. 08 


56 


C 


SE of Gain 


. 83 


. 66 




T 


10. 90^!^* 


n. s. 






N=134 


N = 132 


o 


Gain 


4. 89 


1. 71 




SE of Gain 


.86 


. 74 




T 




2. 31'!^ 



^::p <.05 
^'.'':^p < .001 



TABLE 6 

T Tests of Differences Between Gains of Program 
Vs. Control Students 



SES Program Vs. Control 



HIGH 


Diff. of Gain 
9. 86 


T 

8. 69** 


MIDDLE 


9. 64 


9. 05** 




3. 18 


2. 86* 


*p <.01 
**p <.001 



All three SES level program groups have gains which are significant beyond 
the .001 level of confidence. Of the control grou^^s only the low SES students show 
a gain which is significant beyond the .05 level of confidence. The middle SES con- 
trol group even shows a slight loss from pre- to post-tests. There is no data 
which explains why the low SES control group sho\V(»d a r '('st but significant gain. 
It may be that there are different rates of change for rhil( cn who are in the same 
school grade but who are at differing SES levels. 

The similarity of the high and middle SES level students and their dissimilar- 
ity with the low SES level students is illustrated in Table 7, which shows a compari- 
son between gains made by SES program and control groups and pre- to post-tests. 



TABLI-: 7 

T Tests of Gain Scores Between S1']S Levels 


SLS 


Program Control 


HIGH- 
MIDDLE 


Difference in Gain 1.61 1.39 
Std. Error of Difference 1.11 1.09 
T n.s. n.s. 


HIGH- 
LOW 


Difference in Gain 9. 52 -8. 74 
Std. Error of Difference 1.27 1.14 
T 7.50^J=* n.s. 


1 

W 

-J > 

Q 6 


Difference in Gain 4.19 -2.27 
Std. Error of Difference 1.17 .99 
T 3.57^1='!' 2.28- 


^:^p <.05 



Teacher Acquaintance with Materials 

For purposes of this study, teachers were composed of three types: Teach- 
ers who had taught the program the previous year (experienced), teachers who were 
teaching the program for the first time but who were given one day of in-service 
training with the materials (trained), and teachers without experience who received 
no prior training with the materials (non-trained). Table 8 shows the means and 
standard deviations of the pre- and post-tests scores and the number of students in 
the groups with the three types of teachers among the three SES levels. The corre- 
lations between the pre- and post-tests are also shown. 

Table 9 expresses the same data in terms of gain from pre-test to pont-test. 
The average gain for each group and their standard deviations are given. 



er!q 



TABLE 8 

Means, Standard Deviations and Correlations Between Pre- and Post-'l'ests 
Taken by Program Students of [experienced. Trained, and Non- 
Trained Teachers for Each of the SES Levels 



c; ir c: 


Experienced 


Trained 


I\'on -T 


rained 






Pre 




Pre 


Post 


Pre 




Post 






N-126 




N = 


172 


N - 


164 






Mean 


38. 43 


52. n.; 


35.71 


46. 23 


38. 62 




4 9. 31 


o 


S.D. 


9. 08 


13. 26 


9. 87 


14. 13 


9. 40 




12. 26 






.59 






. 70 : 
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65 






(pre- 


post) 














Pre 


Post 


Pre 


Post 


Pre 




Post 


w 




N=155 




N = 


131 


N - 


1 59 




Q 


Mean 


38. 31 


45. 33 


38. 91 


46.44 


39. 15 




48. 23 


Q 


S.D. 


11. 72 


14.76 


11. 84 


13. 78 


y. oo 




12. 94 




r , 
(pre- 


post) '^^ 






74 




61 








Pre 


Post 


Pre 


Post . 


Pre 




Post 






N-77 






Ill 


N = 


134 




o 


Mean 


32. 10 


41. 84 


30. 37 


42. 30 


2 9'.. 9 5 




34. 83 




S.D. 


9. 61 


11. 85 


8. m 


13. 03 


a, 91 




9. 87 




. "^(pre- 


post) '^'^ 






61 




49 





TABLE 9 

Meansiand Standard Deviations of Gain Scores 
vrrr the Different Program Students 
in Each of the SES Levels 





ExperiiSEECied 


T rained 


Non-T rained 


HIGH 

1 


Gain 14^,411 
S.D. 10,7JFf^ 


10. 52 
1.0. 08 


10. 69 
9.41 




Gain 7, 02 
S.D. 9.7.2 


54 
^i-;. 3 7 


9. 08 
1.0. 48 


0 

-J 


Gain 9.7 5 
S.D. 8.94 


111- 93 
101. 39 


4. 89 
9. 54 



All of the groups that took the economics program showed gains which were 
significant beyond the .001 level of confidence. Our concern here is with the effect 
of the amount of teacher acquaintance with the program within each SES level and 
not with the differences between SES levels for a given amount of teacher acquain- 
tance with the program. Table 10 shows T tests of significance between classes 
within each SES level whose teachers had varying acquaintance with the materials 



TABLE 10 

T Tests Significance Hetween Program Students Whose Teachers 
had Varying Acquaintance with the Alaterials 







Experienced Vs. 


Experienced \'s. 


Trained \'s. 


SES 




T rained 


Non-Trained 


Non-T rained 




Difference of Gain 


3-89- 


3. 71 


(-). 1.7 










1. 07 


o 


Std. Error of Difference 


K23 


1.21 




T 


3. 15^ 


3. 06* 


n. s. 


w 


Difference in Gain 


['^. 52 


(02.06 


(-)l. 54 


D 


Std- Error of Difference 


1. 14 


1. 14 


1.17 


C 












T 


n. s , 


n. s . 


n, s. 


*^ 








DifH?rence of Ga n 


(-)2, \-^} 


4. 85 


1 7. 04 












% 


Std. Error of Difference 


1.47 


1. 37 


^ 1. 29 




T 


n. s. 


3. 55** 


5.45-* 



*P < -.01 
^'''P < . 001 



Concclusions 



Program Compared to Control Groups 



ERLC 



Of the program groups whuose teaidiers had ixo prior acquaintance with the ma- 
terial, the highest gain was made by tiaie high SES group aiM lowest gain was made 
by the low ^IS ;g3-tmp. The poor^ shxBsidiiig of the low SES |>rogram students and the 
.greater showing toi the. low SES controi students is reflected by the smaller differ- 
e5Ec:e of gain teompared with the high aisd middle SES groups. The low group had 
aiiout one-third tb# ^SiEference in gain compared to the other two groups. However, 
the difference in gaM: for the low SES students is still significant beyond the .01 lev- 
el of confidence. There was no significant difference in intelligence scores between 
these program and control groups at any SES level. 

It is beyond the scope of this paper to determine whether the comparatively 
small difference in gain score between the low SES program students over control 
students (3.1.8 percentage points) is large enough to justify using this program in- 
stead of a mere traditional social studies program. However, the evidence of this 
research indicates that, in general, a significantly greater amount of economics is 
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learned by students who ar-. taught the prograin than by students who are exposed 
to the regular social stuiiciir::f= curricula of their schools. Farther, many teachers 
of the low SES students :iTer.jjrt a greater amount of interest and "coming alive" in 
their classes^ The amo^nsTX learned apparently does vary with students of differing 
socioeconomic levels. 

Teacher Acquaintance wheIh Materials 

The only groups wism sre different in gain scores from others on the same 
SES level are the most precdictablr .uies. High SES students whose teacher had 
taught the program in tife previous year show the highest gains from tiie program 
while low SES students ^uose teacher had never seen the materials have the low- 
est gain. Of the remarrimnig students there seems to be no evidence that the amount 
of teacher acquaintance with the materials will make very much difference. 

The small but sts:i^^tically significant differences in intelligenc.e test scoi^es 
within the middle and L3>^??r5SlS levels would mot seem to change these conclusions. 
At the middle SES levei oi^e 722-ogram studenits with experienced teachers were lower 
than control students in: iisEieiiigence test scores but higher in ^ain scorsts on the eco- 
nomic tests. At the low level, the program students wif experienced teachers 
were higher in intellige:]ime ttc-sn: scores than the other two p rolipram gr'U5iLi>s at tlbe low 
SES level, but this saTTFe ^'onp fead gain scores which fell cmlv midwa:v : -veen the 
other two program grtTrnrr^r^. Tiie partem of differences in iiiEt^Iligenct:' tt- cores 
does not seem to relaae ;ii±i^ pattern of differences in gain scores oti: the jonomic 
tests. 

While our evidetiiGf jnEnniiciiU s somewhat greater learning on the xEanrt of students 
whose teachers were e^xpeirmmited or trained, in the program, it was fmmd t±iat teach- 
ers who have no acquaixr:rs3w^' ^ath nke program will be-able to teach tfere program ef- 
fectively. It may be tha' ^^seefstrucrare of the program, siumg with the detailed 
teacher^s guide and the - ^^.fcgiroimd essays which are proTOTided ^ith the program, 
contribute to the teacha nrf^paration and to the amount of smceess acrrniieved. 
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